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Lecture 10. Tuesday, Mar 10 

All of this is easy to find in the various reference notes and/or books so I will 
keep these notes very brief. 

(1) Besscl's inequality 

If in a preHilbert space H, Ci, i = 1, . . . , N are orthonormal - so (ei, Cj) = 
6ij then for any element u G H, set 

N 

V = '^^{u,ei)ei then 

i=l 

(10.1) ^ 

i=l 

{u — v) -L Ci, i = 1, . . . ,N. 

The last statement follows immediately by computing (m, ej) = (u, Cj) and 
similarly can be computed directly. Then the inequality, which is 

Bessel's inequality, follows from Cauchy's inequality since from the last 
statement 

(10.2) = {v,v) = {v,u) + {v,v — u) = {v,u) = \ {v,u)\ < ||v||||u|| 

shows ||f|| < 

(2) Orthonormal bases: 

Since in the inequality in (10.1) the right side is independent of N it 
follows that if {ci}'?!-^ is a countable orthonormal set then 

oo 

(10.3) Y.\iu,ei)f<\\u\\l. 

i = l 

From this it follows that the sequence 

n 

(10.4) Vn = ^{u,ei)ei 

i=l 

is Cauchy since if m > n. 



(10.5) \\Vn-Vm\\''= Il(«'e,)r< II ("'^. 

n<j<m j=n+l 

and the right side is small if n is large, independent of m. 

Lemma 5. If H is a Hilbert space - so now we assume completeness - and 
{cj}-^! is an orthonormal sequence then for each u & H, 

oo 

(10.6) u = E(M,ej)ej e if 

i=i 

converges and (u — w) _L Cj for all j. 

Proof. The limit exists since the sequence is Cauchy and the space is com- 
plete. The orthogonality follows from the fact that (m — w„, Cj) — as soon 
as n> j and 

(10.7) {u — v,ej)= lim (« — i;„, ej) = 
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by continuity of the inner product (which follows from Cauchy's inequality). 

□ 

Now, wc say an orthonormal sequence is complete, or is and orthonormal 
basis of if w _L ej = for all j implies u = 0. Then we see:- 

Proposition 15. //{ejH^l^ is an orthonormal basis in a Hilbert space H 

then 

(10.8) u = Y^{u, ej)ej M u&H. 

Proof. Prom the lemma the series converges to v and {u — v) _L Cj for all j 
so by the assumed completeness, u = v which is (10.8). □ 

(3) Gram-Schmidt 

Theorem 6. Every separable Hilbert space has an orthonormal basis. 

Proof. Take a countable dense subset which can be arranged as a se- 
quence {vj} and the existence of which is the definition of separability - 
and orthonormalize it. Thus if t;i ^ set Cj = ui/|| ('i||. Proceeding by 
induction we c;an suppose to have found for a given integer n elements e^, 
i = 1, . . . , m, where m < n, which are orthonormal and such that the linear 
span 

(10.9) sp(ei,...,e„) = sp(vi, . . . ,u„). 

To show the inductive step observe that if Vn+i is in the span(s) in (10.9) 
then the same work for n + 1. So it follows that 

n 

(10.10) w = Vn+i - '^{vn+1, ej)ej ^ so Cm+l = T—r; 

j=l ll^ll 

makes sense. Adding Cm+i gives the equality of the spans for n+ 1. 

Thus we may continue indefinitely. There are only two possibilities, 

either we get a finite set of e,i's or an infinite sequence. In either case this 
must be an orthonormal basis. That is we claim 

(10.11) i? 9 u_L Cj- V J ^ u = 0. 

This uses the density of the v^s. That is, there must exist a sequence Wj 
where each Wj is a w„, such that Wj —^uinH. Now, each each w„, and hence 
each Wj, is a finite linear combination of Cfc's so, by Bessel's inequality 

(10.12) Wwjf = E IK'^fe)!' = E - ^ II" - "'ill' 

fe k 

where {u, ej) = for all j has been used. Thus \\wj\\ and u = 0. □ 

(4) Isomorphism to P 

A finite dimensional Hilbert space is isomorphic to C" with its standard 
inner product. Similarly from the result above 

Proposition 16. Any infinite-dimensional separable Hilbert space (over 
the complex numbers) is isomorphic to that is there exists a linear map 

(10.13) T:H — > L'^ 
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which is 1-1, onto and satisfies {Tu,Tv)i2 — (u,v)h and \\Tu\\i2 = \\u\\h 
for all u, V G H. 

Proof. Choose an orthonormal basis - which exists by the discussion above 
and set 

(10.14) Tu={{u,ej)\\fLi. 

This maps H into l'^ by Bessel's inequaUty. Moreover, it is Unear since 
the entries in the sequence are Hnear in u. It is 1-1 since Tu = impUes 

{u,ej) = for all j implies m = by the assumed completeness of the 
orthonormal basis. It is surjective since if {cj}^i then 

oo 

(10.15) u = ^Cjej 

i=i 

converges in H. This is the same argument as above - the sequence of 
partial sums is Cauchy by Bessel's inequality. Again by continuity of the 
inner product, Tu = {cj} so T is surjective. 

The equality of the norms follows from equality of the inner products 
and the latter follows by computation for finite linear combinations of the 
Bj and then in general by continuity. □ 
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Problem set 5, Due llAM Tuesday 17 Mar. 

You should be thinking about using Lebesgue's dominated convergence at several 
points below. 
Problem 5.1 

Let / : M — > C be an element of C^iR). Define 



(10.16) fL{x) 



\f{x) x&[~L,L\ 
otherwise. 



Show that Jl e C\M.) and that / |/l - /| ^ as L ^ oo. 

Problem 5.2 Consider a real- valued function / : R — > R which is locally inte- 
grable in the sense that 



(10.17) gL{x) 



fix) xe[-L,L] 
xgR\[-L,L] 

is Lebesgue integrable of each L e N. 

(1) Show that for each fixed L the function 

(gL{x) ifgL{x)e[-N,N] 

(10.18) g[^\x)^lN if gL{x)>N 

[-N iigL{x)<-N 

is Lebesgue integrable. 

(2) Show that / \gf^ - gL\ ^ as N oo. 

(3) Show that there is a sequence, of step functions such that 

(10.19) hn{x) f(x) a.e. in R. 

(4) Defining 

'0 x^[-L,L] 

hn{x) if K{x) e [-N,N], X e [-L,L] 

N ifhn{x) > N, xe [-L,L] 
-N if hn{x) < -N, X e [-L, L] 

Show that J — .g^^"* | ^ as n ^ oo. 
Problem 5.3 Show that £^(R) is a Hilbert space. 

First working with real functions, define £^ (M) as the set of functions / : R — > R 
which are locally integrable and such that |/p is integrable. 

(1) For such / choose /i„ and define gL, g^j^^ and by (10.17), (10.18) and 
(10.20). 

(2) Show using the sequence h^^l for fixed N and L that g'"^^ and (5^^')^ are 
in £i(R) and that / Hh^^l)^ - (5^^)'! ^ as n ^ 00. 

(3) Show that (^l)^ e C\m.) and that / \{gi^^)'^ - {gL)^\ ^ as TV ^ 00. 

(4) Show that / |(.gL)2 - p\ ^ as L ^ 00. 

(5) Show that f,ge C^iR) then fg e £^{R) and that 

(10.21) \l^3\<l \f9\ < ii/iu^ii5iu^, mh = I Iff- 



(10.20) = { 
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(6) Use these constructions to show that £^(R) is a Unear space. 

(7) Conclude that the quotient space i^(]R) = jC'^{R)/J\f, where Af is the space 
of null functions, is a real Hilbert space. 

(8) Extend the arguments to the case of complex- valued functions. 
Problem 5.4 

Consider the sequence space 

(10.22) /i^'i = |c:N9 j^Cj- G C; ^(1 + /)|c^.|2 < oo 

(1) Show that 

(10.23) /i^'^ X /i^'i B (c, d) I — y (c, d) = ^(1 + f)cjdj 

j 

is an Hermitian inner form which turns /i'^'^ into a Hilbert space. 

(2) Denoting the norm on this space by || • ||2,i and the norm on P by || • ||2, 
show that 

(10.24) h^'^cl^ ||c||2 < l|cl|2,i Vce ;j2,i^ 

Problem 5.5 In the separable case, prove Riesz Representation Theorem directly. 
Choose an orthonormal basis {ej} of the separable Hilbert space H. Suppose 
T : H — > C is a bounded linear functional. Define a sequence 



(10.25) = T(ei), i € N. 

(1) Now, recall that \Tu\ < C\\u\\h for some constant C. Show that for every 
finite N, 

N 

(10.26) ^\wi\^<C^. 

j=i 

(2) Conclude that {wi} G P and that 

(10.27) w = '^w^e^€H. 

i 

(3) Show that 

(10.28) T{u) = (u,w}Hy uG H and \\T\\ = \\w\\h. 
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Solutions to Problem set 4 

Just to compensate for last week, I will make this problem set too short and 
easy! 

Problem 4-1 

Let H he a, normed space in which the norm satisfies the parallelogram law: 

(10.29) \\u + + \\u - vf = 2{\\uf + \\vf) yu,vGH. 

Show that the norm comes from a positive definite sesquilinear (i.e. Hermitian) 
inner product. Big Hint:- Try 

(10.30) {u,v) = ^ + - vll^ + i||u + TO||^ -i\\u-iv\f)\ 
Solution: Setting u = v, even without the parallelogram law, 

(10.31) {u,u) = ^ ||2u||2 + i||(l + i)u||^-i||(l-i)u||^) = 

So the point is that the parallelogram law shows that {u, v) is indeed an Hermitian 
inner product. Taking complex conjugates and using properties of the norm, + 

if II = ||w — iu\\ etc 

1 



(10.32) {u,v) = - {\\v + uf- \\v - uf - i\\v - iu\\^ + i\\v + iuf) = {v,u). 

Thus we only need check the linearity in the first variable. This is a little tricky! 
First compute away. Directly from the identity {u,—v) = —{u,v) so {—u,v) = 
-{u,v) using (10.32). Now, 
(10.33) 

(2u,v)=l{\\u+{u + v)r-\\u+iu-v)r 
+ i\\u +{u + iv)f - i\\u +{u- iv)f) 

^ /II I I|2 I II ||2 II ||2 II ||2 



+ i\\{u + iv)\\'^ + — i\\u — iv\\'^ — 

■'■ ' ^"2 IL. „.M|2 I -IL. C». I „-,.M|2 



^ — {u + v)\\'^ — \\u — {u — v)]]"^ + i\\u — {u + iv)\\^ — i\\u — {u — w)||^) 
=2{u,v). 

Using this and (10.32), for any u, u' and v, 

{u + u', v) = ^{u + u' , 2v) 

= 2 + + + -\\{u-v) + in' v)\\' 

+ i\\{u + iv) + {u- iv)\\'^ - i\\{u-iv) + {u' - iv)\\'^) 

(10.34) ~^ (II" '^11 II'"' '^11^ ~ II" ~ '^11 ~ 11"' ~ '^11^ 

+ i\\{u + iv)\\'^ + i\\u — iv\\'^ — i\\u — iv\\ — i\\u' — iv\\'^) 

-ll{\\{u + v)-{u' + v)f-\\iu-v)- iu' -v)f 

+ i\\{u + iv) - (u - iw)|P - i||(u - iv) = [u' - iv)\\^) 
= {u,v) + {u',v). 
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Using the second identity to iterate the first it follows that {ku, v) = k{u, v) for any 
u and V and any positive integer k. Then setting nu' = u for any other positive 

integer and r = k/n, it follows that 

(10.35) {ru,v) = {ku',v) = k{u',v) = rn{u',v) = r{u,v) 

where the identity is reversed. Thus it follows that (ru, v) — r(u, v) for any rational 
r. Now, from the definition both sides are continuous in the first element, with 
respect to the norm, so we can pass to the limit as r — > a; in R. Also directly from 
the definition, 

(10.36) {iu, v) = ^ {\\iu + v\\'^ — \\iu — + i\\iu + iv\\'^ — i\\iu — = i{u, v) 

so now full linearity in the first variable follows and that is all we need. 

Problem 4-2 

Let ff be a finite dimensional (pre)Hilbert space. So, by definition H has a basis 
{vi}f^i, meaning that any element of H can be written 

(10.37) v = Y. 

i 

and there is no dependence relation between the w^'s ~ the presentation of w = in 
the form (10.37) is unique. Show that H has an orthonormal basis, {e^}"^]^ satis- 
fying {ei,ej) = Sij (= 1 if i = j and otherwise). Check that for the orthonormal 
basis the coefficients in (10.37) are Cj = {v, e,) and that the map 

(10.38) T:H5v< — > {{v , a)) € C"- 
is a linear isomorphism with the properties 

(10.39) {u,v) = ^{Tu)i{Tv)i, II u\\h = IITmIIc y u,v e h. 

i 

Why is a finite dimensional prcHilbert space a Hilbert space? 

Solution: Since H is assumed to be finite dimensional, it has a basis Vi, i = 
l,...,n. This basis can be replaced by an orthonormal basis in n steps. First 
replace vi by ei — tii/||wi|| where ^ by the linear indepedence of the basis. 
Then replace V2 by 

(10.40) 62 = «;2/||w2||, W2 = V2 — (t'2,ei)ei. 

Here W2 -L ei as follows by taking inner products; u;2 cannot vanish since V2 and e\ 
must be linearly independent. Proceeding by finite induction we may assume that 
we have replaced vi, V2, ■ ■ ■ , Vk, k < n, by ei, 62, . . . , Ck which are orthonormal 
and span the same subspace as the Vi^s i = 1, . . . ,k. Then replace Vk+i by 

fc 

(10.41) efe+i = «;fe+i/||M;fc+i||, Wk+i = Vk+i -'^{vk+i,ei)ei. 

i=l 

By taking inner products, Wk+i -L e^, i = l,...,k and Wk+i ^ by the linear 

independence of the w^'s. Thus the orthonormal set has been increased by one 
element preserving the same properties and hence the basis can be orthonormalized. 
Now, for each u G H set 

(10.42) Ci = {u,ei). 
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n 



It follows that U = u — CiCi is orthogonal to all the Ci since 

i=l 



(10.43) {u, Cj) = {u, Cj) - ^ Ci{ei, ej) = {u.ej) - cj = 0. 



This implies that U — since writing U = diCi it follows that di = {U,ei) — 0. 



Now, consider the map (10.38). We have just shown that this map is injective, 
since Tu = implies = for all i and hence w = 0. It is linear since the depend 
linearly on u by the linearity of the inner product in the first variable. Moreover 
it is surjective, since for any q G C, u = ^c^ei reproduces the q through (10.42). 



Thus T is a linear isomorphism and the first identity in (10.39) follows by direct 
computation:- 



Setting u = V shows that HTwHc" = 

Now, we know that C" is complete with its standard norm. Since T is an 
isomorphism, it carries Cauchy sequences in H to Cauchy sequences in C" and 
carries convergent sequences in C" to convergent sequences in H, so every Cauchy 
sequence in H is convergent. Thus H is complete. 



n 



i=l i 



(10.44) 




= {u,v). 



